Bessel models for GSp(4): Siegel vectors of square- free level 
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Abstract. We determine test vectors and explicit formulas for all Bessel models for 
those Iwahori-spherical representations of GSp 4 over a p-adic held that have non-zero 
vectors fixed under the Siegel congruence subgroup. 

1 Introduction 

For various classical groups, Bessel models of local or global representations have proven to be a 
useful substitute for the frequently missing Whittaker model. The uniqueness of Bessel models 
in the local non-archimedean case has now been established in a wide variety of cases; see [1], 
[3]. In this work we are only concerned with the group GSp 4 over a p-adic field F, for which 
uniqueness of Bessel models was proven as early as 1973; see [4]. 

Other than Whittaker models, which are essentially independent of any choices made, Bessel 
models depend on some arithmetic data. In the case of GSp 4 , part of this data is a choice of 
non-degenerate symmetric 2 x 2-matrix S over the field F. The discriminant d of this matrix 
determines a quadratic extension L of F; this extension may be isomorphic to F ® F, which will 
be referred to as the split case. The second ingredient entering into the definition of a Bessel 
model is a character A of the multiplicative group L x . 

Now let (-7T, V) be an irreducible, admissible representation of GSp 4 (F). Given S and A, the 
representation tt may or may not have a Bessel model with respect to this data. In the case of 
GSp 4 , it is possible to precisely say which representations have which Bessel models; see [7]. In 
particular, every irreducible, admissible representation has a Bessel model for an appropriate 
choice of S and A. 

Given tt, S and A, it is one thing to know that a Bessel model exists, but it is another to 
identify a good test vector. By definition, a test vector is a vector in the space of ir on which 
the relevant Bessel functional is non-zero. Equivalently, in the actual Bessel model consisting of 
functions B on the group with the Bessel transformation property, B is a test vector if and only 
if B(l) is non-zero. In this paper, we will identify test vectors for a class of representations that 
is relevant for the theory of Siegel modular forms of degree 2. In addition, we shall give explicit 
formulas for the corresponding Bessel functions. See [5], [9] for the Steinberg case and [12] for 
the spherical case. 

More precisely, the class of representations we consider are those that have a non-zero vector 
invariant under Pi, the Siegel (To-type) congruence subgroup of level p. These representations 
appear as local components of global automorphic representations generated by Siegel modular 
forms of degree 2 with respect to the congruence subgroup Fq(N), where N is a square- free 
positive integer. They fall naturally into thirteen classes, only four of which consist of generic 
representations (meaning representations that admit a Whittaker model); see our Table 1 below. 

Of the thirteen classes, six are actually spherical, meaning they have a non-zero vector 
invariant under the maximal compact subgroup GSp 4 (o) (here, is the ring of integers of our 
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local field F). Sugano [12] has given test vectors and explicit formulas in the spherical cases. 
Our main focus, therefore, is on the seven classes consisting of non-spherical representations 
with non-zero Pi-fixed vectors. Of those, five classes have a one-dimensional space of Pi-fixed 
vectors, and two classes have a two-dimensional space of Pi-fixed vectors. The one-dimensional 
cases require a slightly different treatment from the two-dimensional cases. In all cases, our 
main tool will be two Hecke operators T^o and To i, coming from the double cosets 



Evidently, these operators act on the spaces of Pi-invariant vectors. In Sect. 3 we give their 
eigenvalues for all of our seven classes of representations. The results are contained in Table 3. 
In the one-dimensional cases, trivially, the unique Pi -invariant vector is a common eigenvector 
for both Ti ; o and To,i- I n the two-dimensional cases, it turns out there is a nice basis consisting 
of common eigenvectors for T±fi and T^i. 

In Sect. 5 we will apply the two Hecke operators to Pi-invariant Bessel functions B and 
evaluate at certain elements of GSp 4 (P). Assuming that B is an eigenfunction, this leads to 
several formulas relating the values of B at various elements of the group; see Lemma 5.1 as an 
example for this kind of result. The calculations are all based on a GL2 integration formula, 
which we establish in Lemma 4.3. 

In Sect. 6 we use some of these formulas to establish a generating series for the values of B 
at diagonal elements; see Proposition 6.1. It turns out that there is one "initial element" 



where m,Q is the conductor of the Bessel character A; see (31) for the precise definition. If 
B(h(0,mo)) = 0, then B is zero on all diagonal elements. 

A generating series like in Proposition 6.1 is precisely the kind of result that will be useful 
in global applications. However, it still has to be established that B(h(0, mo)) 7^ 0; this is the 
test vector problem, and it is not trivial since B may vanish on all diagonal elements and yet 
be non-zero. It turns out that, in almost all cases, B(h(0,mo)) 7^ as expected; see our main 
results Theorem 8.2 and Theorem 9.3. 

However, there is one exceptional case, occurring only for split Bessel models of representa- 
tions of type Ha, and then only for a certain unramified Bessel character A. In this very special 
case, our Bessel function B is non-zero not at the identity, as expected, but at a certain other 
element; see Theorem 8.2 i) for the precise statement. 

To handle this exceptional case, and one other split case for Via type representations, we 
require an additional tool besides our Hecke operators. This additional tool are zeta integrals, 
which are closely related to split Bessel models. We also require part of the theory of paramodular 
vectors from [8]. Roughly speaking, we take paramodular vectors and "Siegelize" them to obtain 
Pi-invariant vectors. Calculations with zeta integrals then establish the desired non-vanishing 
at specific elements. This is the topic of Sect. 7. 

The final Sects. 8 and 9 contain our main results. Theorem 8.2 exhibits test vectors in 
all one-dimensional cases, and Theorem 9.3 exhibits test vectors in all two-dimensional cases. 
As mentioned above, explicit formulas for these vectors can be found in Proposition 6.1. We 
mention that, evidently, explicit formulas imply uniqueness of Bessel models. Hence, as a by- 
product of our calculations, we reprove the uniqueness of these models for the representations 
under consideration. 





h(0,m ) = diag(ro 2mo ,n7 mo ,l,w mo ), 
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Let us remark here that the proofs of several of the lemmas in this paper are very long but 
not conceptually very deep. Hence, we have omitted the proofs of these results. We direct the 
reader to [6] for a longer version of this article which contains all the details of the proofs. 

2 Basic facts and definitions 

Let F be a non-archimedean local field of characteristic zero, o its ring of integers, p the maximal 
ideal of o, and vj a generator of p. We fix a non-trivial character ip of F such that ijj is trivial 
on o but non-trivial on p _1 . We let v be the normalized valuation map on F. 
As in [2] we fix three elements a, b, c in F such that d = b 2 — 4ac 7^ 0. Let 




Then = F + F£ is a two-dimensional F-algebra. If d is not a square in F x , then F(£) is 
isomorphic to the field L = F(\/d) via the map x + y£, 1— > x + y^r. If d is a square in F x , then 

F(£) is isomorphic to L = F © F via x + y£ 1— > (x + y^,x — y^)- Let zH>zbe the obvious 
involution on L whose fixed point set is F. The determinant map on F{£) corresponds to the 
norm map on L, defined by N(z) = zz. Let 



One can check that T(F) = F(£) x , so that T(F) = L x via the isomorphism F(£) = L. We 
define the Legendre symbol as 



These three cases are referred to as the inert case, ramified case, and split case, respectively. If 
L is a field, then let Ol be its ring of integers and pi be the maximal ideal of Ol- If L = F © F, 
then let Ol = © 0. Let wl be a uniformizer in Ol if L is a field, and set wl = (zu, 1) if L is 
not a field. In the field case let vl be the normalized valuation on L. Except in Sect. 7, where 
we consider certain split cases, we will make the following standard assumptions, 

• a, b 6 and c G o x . 

• If d ^ F x2 , then d is a generator of the discriminant of L/F. (4) 

• If d G F x2 , then d G o x . 

Under these assumptions, the group T(o) := T(F) n GL2(o) is isomorphic to o£ via the isomor- 
phism T(F) L x . 

Under our assumptions (4) it makes sense to consider the quadratic equation eu 2 +bu+a = 
over the residue class field o/p. The number of solutions of this equation is (^) + 1. In the 
ramified case we will fix an element uq G and in the split case we will fix two mod p inequivalent 
elements u\ , U2 G such that 



T(F) = {ge GL 2 (F) : 'gSg = det( 5 )5}. 



(2) 



(-1 



if L/F is an unramified field extension, 
if L/F is a ramified field extension, 
if L = F © F. 




(3) 



cu\ + hui + a G p, i = 0, 1, 2. 



(5) 
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Groups 



We define the group GSp 4 , considered as an algebraic F-group, using the symplectic form 
1 2 " 



J 



. Hence, GSp 4 (F) = {g G GL 4 (F) : gJg = fi(g)J}, where the scalar fi(g) G F x is 



called the multiplier of g. Let Z be the center of GSp 4 . Let B denote the Borel subgroup, P the 
Siegel parabolic subgroup, and Q the Klingen parabolic subgroup of GSp 4 . Let K = GSp 4 (o) be 
the standard maximal compact subgroup of GSp 4 (F). The parahoric subgroups corresponding 
to B, P and Q are the Iwahori subgroup I, the Siegel congruence subgroup P±, and the Klingen 
congruence subgroup P2, given by 



p 
0000 
p p 
p p p 



Pi = Kn 



0000 
0000 
p p 
p p 



P2 = Kn 



p 
0000 
p 
p p p 



(6) 



We will also have occasion to consider, for a non-negative integer n, the paramodular group of 
level p n , defined as 



#para (pn) = {g £ GS p 4 (F) : g G 



p" 

p - ' 



1" 



p n p n p n 



, det( 5 ) G o x }. 



(7) 



The eight-element Weyl group W of GSp 4 , defined in the usual way as the normalizer modulo 
the centralizer of the subgroup of diagonal matrices, is generated by the images of 



1 



1 



and 



S2 



(8) 



Bessel models 



G GSp 4 (F). 



(9) 



Let a, b, c, the matrix S and the torus T{F) be as above. We consider T(F) a subgroup of 
GSp 4 (F) via 

Let U(F) be the unipotent radical of the Siegel parabolic subgroup P and R(F) = T(F)U(F). 
We call R(F) the Bessel subgroup of GSp 4 (-F) (with respect to the given data a, b,c). Let 
6 : U(F) — > C x be the character given by 



0( 



1 X 

1 



^(tr(SX)), 



(10) 



where tp is our fixed character of F of conductor 0. We have 9(t 1 ut) = 0{u) for all u G U{F) 
and t G T(F). Hence, if A is any character of T(F), then the map tu 1— > A(t)0(u) defines a 
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character of R(F). We denote this character by A <g> 9. Let <S(A, 0) be the space of all locally 
constant functions B : GSp 4 (-F) — > C with the Bessel transformation property 

B(rg) = (A® 6)(r)B{g) for all r G i?(F) and g e GSp 4 (F). (11) 

Our main object of investigation is the subspace <S(A, 6, P±) consisting of functions that are right 
invariant under P\. The group GSp 4 (-F) acts on S(A,6) by right translation. If an irreducible, 
admissible representation (ir, V) of GSp 4 (F) is isomorphic to a subrepresentation of <S(A, 9), 
then this realization of tt is called a (A, 6) -Bessel model. It is known by [4], [7] that such a 
model, if it exists, is unique; we denote it by B^q{tt). Since the Bessel subgroup contains the 
center, an obvious necessary condition for existence is A(z) = oj n (z) for all z G F x , where u n is 
the central character of n. 



Change of models 



Of course, Bessel models can be defined with respect to any non-degenerate symmetric matrix 
S, not necessarily subject to the conditions (4) we imposed on a, b, c. Since our calculations 
and explicit formulas will assume these conditions, we shall briefly describe how to switch to 
more general Bessel models. Hence, let A be in F x and A be in GL2(F), and let 5' = X l ASA. 
Replacing S by S' in the definitions (2) and (10), we obtain the group T'{F) and the character 9' 
of U(F). There is an isomorphism T'(F) — > T(F) given by 1 1 — ?- AtA' 1 . Let A' be the character 

of T'(F) given by A'(t) = A(AtA~ 1 ). For B G B A ,e^), let B'{g) = B( A x -it A -i d), for 

g G GSp 4 (-F). It is easily verified that B' has the (A', #')-Bessel transformation property, and 
that the map B i— >• B' provides an isomorphism &^q(tt) = B\' t o'(n). 



Let S 



be the usual matrix such that d = b 2 — 4ac is a square in F x , and let 



S' 



1/2 



1/2 



(12) 



1 and A = 4r 

Vd 



Then we can take A 
torus T'(F) is explicitly given by 



1 -2c 
■±(b->/d) h + Vd 



above to get S' = l ASA. The 



T\F) = { 



d 



: a,d G F x }. 



(13) 



If B G S(A,9,Pi) and B is a T\p eigenfunction (see (15)) with non-zero eigenvalue then an 
explicit computation shows that 



B'{\) ^ 



B(1)^0. 



(14) 



See [6] for details. 
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The Iwahori-spherical representations of GSp 4 (F) and their Bessel models 

Table 1 below is a reproduction of Table A. 15 of [8]. It lists all the irreducible, admissible 
representations of GSp 4 (i ? ) that have a non-zero fixed vector under the Iwahori subgroup /, in a 
notation borrowed from [10]. In Table 1, all characters are assumed to be unramified. Further, 
Table 1 lists the dimensions of the spaces of fixed vectors under the various parahoric subgroup; 
every parahoric subgroup is conjugate to exactly one of K, Pq2, P2, Pi or I. In this paper we 
are interested in the representations that have a non-zero Pi-invariant vector. Except for the 
one-dimensional representations, these are the following: 

• I, lib, Illb, IVd, Vd and VId. These are the spherical representations, meaning they have 
a A'-invariant vecor. 

• Ha, IVc, Vb, Via and VIb. These are non-spherical representations that have a one- 
dimensional space of -Pi-fixed vectors. Note that Vc is simply a twist of Vb by the character 
£, so we will not list it separately. 

• Ilia and IVb. These are the non-spherical representations that have a two-dimensional 
space of Pi-fixed vectors. 

Let 7r be any irreducible, admissible representation of GSp 4 (i ? ). Let S be a matrix as 
in (1), and 9 the associated character of U(F); see (10). Given this data, one may ask for 
which characters A of the torus T(F), defined in (2) and embedded into GSp 4 (F) via (9), the 
representation tt admits a (A, #)-Bessel model. This question can be answered, based on results 
from [7]. We have listed the data relevant for our current purposes in Table 2. Note that, in 
this table, the characters x->Xi 1X2 are not necessarily assumed to be unramified, i.e., these 
results hold for all Borel-induced representations. For the split case L = F © F in Table 2, 
it is assumed that the matrix S is the one in (12). The resulting torus T(F) is given in (13); 
embedded into GSp 4 (i ? ) it consists of all matrices diag(a, b, b, a) with a, b in F x . 



3 Hecke eigenvalues 

For integers I and m, let h(l, m) be as in (25). Let (ir, V) be a smooth representation of GSp 4 (i ? ) 
for which Z(o) acts trivially. We define two endomorphisms of V by the formulas 



TinV 



Tqav 



1 



vol(Pi) 
1 

vo!(Pi) 



ir(g)vdg, 



Plh(l,0)Pi 



ir{g)vdg 



Pi/i(0,l)Pi 



(15) 
(16) 



and the Atkin-Lehner element 



-1 



zu 



S2S1S2 



-zu 



(17) 



-w 
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Table 1: The Iwahori-spherical representations of GSp 4 (i ? ) and the dimensions of their spaces 
of fixed vectors under the parahoric subgroups. Also listed are the conductor a(n) and the value 
of the e-factor at 1/2. The symbol v stands for the absolute value on F x , normalized such that 
viva) = q , and £ stands for the non-trivial, unramified, quadratic character of F x . 







7T 


a(vr) 


e(l/2,7r) 


if 


P()2 


P2 


Pi 


I 


I 




Xi x X2 X a (irreducible) 





1 


1 


2 

+- 


4 


4 

++ 


8 


II 


a 


xSt G L(2) x a 


1 


-(^x)M 





1 


2 


1 


+ 4 




b 


XlcL(2) x cr 





i 


1 


1 

+ 


2 


3 

+H — 


4 


III 


a 


X x 0-St GSp ( 2 ) 


2 


i 








1 


2 

+ — 


4 

+H 




b 


X » o-1gs p (2) 





i 


1 


2 

-| 


3 


2 


4 

+H 


IV 


a 


cr St GSp (4) 


3 


— cr(ro) 














l 




b 


L(l/ 2 ,l/" 1 crSt GSp(2) ) 


2 


1 








1 


2 

+ — 


3 

+ + — 




c 


^(^ 3/2 st GL{2) ,^- 3 / 2 a) 


1 


— ct(ot) 





1 


2 


1 


3 

H 




d 


(7l GSp(4) 





1 


1 


1 

T 


1 


1 

+ 


l 

+ 


V 


a 




2 


-1 








1 





2 

+- 




b 




1 







1 

+ 


1 


1 

+ 


2 

++ 




c 




1 


—a(w) 





1 


1 


1 


2 




d 







1 


1 





1 


2 

+- 


2 

+- 


VI 


a 


r(5,^ 1 /2 fJ ) 


2 


1 








1 


1 


3 

H 




b 


r(T,v-V 2 a) 


2 


1 











1 

+ 


1 

+ 




c 




1 


— a(vj) 





1 


1 





1 




d 


L(v, l F x x ^ _1 / 2 cr) 





1 


1 


1 

+ 


2 


2 

+- 


3 

++- 
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Table 2: The Bessel models of the irreducible, admissible representations of GSp 4 (i ? ) that can 
be obtained via induction from the Borel subgroup. The symbol N stands for the norm map 
from L x ^ T(F) to F x . 



representation (A, 9) — Bessel model existence condition 



L = F © F L/F a field extension 



I 




Xi ^ X2 ^ & (irreducible) 


all A 




all A 




II 


a 


yStr^T fo\ XI (7 


all A 




A 4 (ya) o N 






b 


ylr^T /o^ X3 <J 


A = (ya) o N 




A = (Va) o AT 

x A V A^ / M * 




III 


a 


V XI 0"Stoc!~/n , \ 


all A 




all A 






h 


A ^ ° - L GSp(2) 


AfHiap-l'n h /) — 

X(a)a(a6) or x{b)a{ab) 








IV 


a 


cr St GSp ( 4 ) 


all A 




A / cjo JV 






b 


L(^ 2 ,^VSt GSp(2) ) 


A = a o V 




A = o- o V 






c 


^(^ 3/2 st GL(2) ,^- 3 /V) 


A(diag(a, b, b, a)) = 
i/(a6 _1 )cr(a6) or u(a~ 1 b)a(ab) 










d 


°"1gSp(4) 










V 


a 




all A 


A/ 




o V 




b 




A = a o N 


A = 


a o N, A ^ (£ct) 


o V 




c 




A = (£ ff ) o JV 


A/ 


a o N, A = (£cr) 


o V 




d 


L(i/£,£ x ^ 1 / 2 ( t) 




A = 


(toJV, A = (£er) 


o V 


VI 


a 


t(S,v-V 2 <t) 


all A 




A/ cjo AT 






b 


r(T, I/-VV) 






A = o- o V 






c 


L(^St GL(2) ^-VV) 


A = a o N 










d 


l F x X Z/ _1 / 2 <t) 


A = a o N 
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Evidently, Ti t o and To i induce endomorphisms of the subspace of V consisting of Pi-invariant 
vectors. Table 3 gives the eigenvalues of and Tq^ on the space of Pi-invariant vectors for 
the representations in Table 1 which have non-zero Pi-invariant vectors, but no non-zero K- 
invariant vectors. We will not give all the details of the eigenvalue calculation, since the method 
is similar to the one employed in [11]. See [6] for details. Table 4 explains the notation. 

Table 3: Eigenvalues of the operators Ti o, Tq i and r\ on spaces of Pi-invariant vectors in 
irreducible representations. 



type 


dim 


7i,o 




V 


Ila 


1 


ceyq 


a 2 -/ 2 (a + a~ l )q z/2 


— Q7 


Ilia 


2 


ajq, jq 


a^ 2 {otq + l)q, a^ 2 (a~ 1 q + l)q 




IVb 


2 


7, 7<? 2 


7 2 (<Z + 1), 7W + 1) 


±7 


IVc 


1 


jq 


l 2 (q 3 + 1) 


-7 


Vb 


1 


-iq 


-l 2 q{q + 1) 


7 


Via 


1 


7<2 


J 2 q{q+1) 


-7 


VIb 


1 


jq 


7 2 g(<? + i) 


7 



We make one more comment on the eigenvalues in Table 3, concerning the representations 
where the space of Pi invariant vectors is two-dimensional. One can verify that the operators 
Ti o and T^i commute, so that there exists a basis of common eigenvectors. The ordering for 
types Ilia and IVb in Table 3 is such that the first eigenvalue for T\$ corresponds to the first 
eigenvalue for Tq \, and the second eigenvalue for T\ o corresponds to the second eigenvalue for 
To,i. 

Table 4: Notation for Satake parameters for those Iwahori-spherical representations listed in Ta- 
ble 3. The "restriction" column reflects the fact that certain charcaters x are n °t allowed in type 
Ila and Ilia representations. The last column shows the central character of the representation. 

type representation parameters restrictions c.c. 

Ila xSt GL(2) x<x a = xH,7 = ffW «V Q* 1 , a + q ±3/2 xV 



Ilia x x o-St GSp (2) a = 7 = cr(ro) a / 1, a / q ±2 x& 

IVb L(i/ 2 ,i/- 1 aSt GSp ( 2 )) 7 = C r(ro) a" 

IVc L(^/ 2 St Gm ,u-^ 2 a) 1 = a(w) 

Vb L(z. 1 /2 eS t GL(2) ,^ 1 /2 (T ) 1 = a{w) a 

Via t(S, v~ l l 2 o) 7 = (7(07) a 2 

VIb T(T,v- x l 2 a) 1 = a{w) a 2 
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Let a, b, c be as in Sect. 2, subject to the conditions (4). Let T(F) be the subgroup of GL 2 (F) 
defined in (2). By [12], Lemma 2-4, there is a disjoint decomposition 



GL 2 (F) = |_| T(F) 



m=0 



ZD 



1 



GL 2 (o) 



(18) 



(here it is important that our assumptions (4) on a, b, c are in force; for example, (18) would 
obviously be wrong for a = c = 0). The following two lemmas provide further decompositions 
for the group GL2(o). We will use the notations 



r (p) = gl 2 (o) n 





po 



and T°(p) = GL 2 (o)n 



op 





(19) 



4.1 Lemma. i) In the inert case (— ) = — 1, 



GL 2 (o) = T(o) 



r (p) = T(o)r°(p). 



(20) 



ii) In the ramified case ( ~) =0, 



GL 2 (o) = T(o) 



1 

U 1 



r (p) u r(o) 



r (p)=T(o) 



" 1 




l" 


n 1 




1 



r°(p) u r(o)r°(p), 

(21) 



with uq as in (5). We have T(o) 



1 

u 1 



r (p) 



1 

Uq 1 



r (p). 



Hi) In the split case (^) = 1, 



GL 2 (o) =T(o) 
= T(o) 



1 

U\ 1 

1 

U\ 1 



r (p) u t(o 
1 



1 

li 2 1 



1 



r>) u T(o) 



r (p) u r(o) 
i 



i 



i 



r (p) 



i 

n 2 1 



1 



with u\,U2 as in (5). We have T(o) 
iv) Let m he a positive integer, and 

T(o) m := 

Then 

GL 2 (o) = T(o) m r (p)UT(o) 
We have T(o) m r (p) = T (p). 



1 

Ui 1 



zu 



r (p) 



T(o) 



1 

Ui 1 



zu 



r°(p) u r(o)r°(p). 

r (p) fori = 1,2. 
nGL 2 (o). 



1 



r (p) = T(o) r 



(22) 



(23) 



r°(p)uT(o) m r°(p). (24) 
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Proof. The lemma follows by using standard representatives for GL 2 (o)/To(p) and the definition 
of T(o). See [6]. ■ 

We turn to double coset decompositions for GSp 4 . For l,m £ Z, let 

J+2m 



h(l, m) 



— 



l+m 



1 



(25) 



Using (18) and the Iwasawa decomposition, it is easy to see that 

GSp 4 (F) = |J R(F)h(l,m)K; 



(26) 



2,mSZ 
m>0 



cf. (3.4.2) of [2]. Using Lemma 4.1, the right coset representatives for KjP\ from [8], Lemma 
5.1.1, and employing the useful identity 



(27) 



"1 




"lz" 1 " 




'-z- 1 ' 




I 




'Iz- 1 ' 


z 1 




1 




—z 




-1 




1 



which holds for z E -F x , we get the following proposition (see [6]). 

4.2 Proposition. i) For m > 0, 

R(F)h(l,m)K = R(F)h(l,m)Pi U R(F)h(l,m)s 2 P 1 

U R(F)h(l,m)sis 2 Pi U R(F)h(l,m)s 2 s 1 s 2 Pi, 

ii) In the inert case (j) = —1, 

R(F)h(l, 0)K = R(F)h(l, 0)i\ U R(F)h(l,0)s 2 P 1 U R(F)h(l, 0)s 2 sis 2 Pi. 

Hi) In the ramified case (^) =0, 

R{F)h(l,0)K = R(F)h(l,0)P 1 U R(F)h(l,0)s 2 P 1 U R(F)h(l,0)s 2 s 1 s 2 P 1 
U J R(F)/i(/,0)u sis 2 Pi, 



where 



u 



1 

u 1 



1 -w 
1 



iv) In the spht case (^) = 1, 



R(F)h(l,0)K = R(F)h(l,0)P 1 U R(F)h(l,0)s 2 P 1 U R{F)h(l,0)s 2 s 1 s 2 P 1 
U J R(F)/i(/,0)uiSis 2 Pi U J R(F)/i(/,0)u 2 sis 2 Pi, 



(28) 



(29) 
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where, for i = 1,2, 



1 

Ui 1 



1 ~Ui 

1 



(30) 



An integration formula 

The integration formula on GL2(o) presented in the following lemma will be used in many of 
our Hecke operator calculations. Let A be a character of L x = T(F). Let 



niQ = min{?n > : AL 



(i+p™Oi)no; 



!}• 



(31) 



4.3 Lemma. Let A be a character of L x = T(F) which is trivial on o x , and let mo be as in 
(31). Let m be a non-negative integer. Let f : GL2(o) — > C be a function with the property 



Htg) = A( 



zu 



1 



w 



1 



)f(g) for all t E T(o) m . 



Let the Haar measure on GL2(o) be normalized such that the total volume is 1. 
i) Assume that f is right invariant under Tq(p). Then 



f(g)dg 



1 



+ 1 



(/(!) + ?/( 



1 



1 



)) 



/( 



GL 2 (o) 





" 1 

u 1 


) + qf( 


1" 

1 




" 1 

U\ 1 


) + /( 


" 1 

U 2 1 



)) 



if m < mo, 
if m > max(?77,o, 1), 

ifm = m = 0, (f) =-1, 

if m = m = 0, (£) =0, 



+ («-!)/( 



1 



)) 



if 777 = 777o = 0, 



1. 
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ii) Assume that f is right invariant under r°(p). Then 

( 



j f(g)dg=< 



GL 2 (o) 







1 



9+1 

/(I) 



(/( 



1 



1 



9+1 
1 

9+1 



(/( 
(/( 



" 1 








r 


Uo 


1 




1 




' 1 








i" 




1 




1 





if m < mo, 
+ 9/(1)) if m > max(mo, 1), 

ifm = m = 0, (f) =-1, 

+ g/(l)) ifm = m = 0, (§) =0, 



+ /( 



" 1 




r 


u 2 1 




1 



+ (9-i)/(i)) 



ifm = m = 0, (§) =1. 



Proof. The lemma follows from Lemma 4.1. ■ 
Automatic vanishing 

Many of the cosets from Proposition 4.2 cannot be in the support of a Bessel function. The 
following lemma exhibits several cases of automatic vanishing. 

4.4 Lemma. Let A be a character of L x = T(F) which is trivial on o x , and let m be as in 
(31 ). Let B G <S(A, 9, Pi), and let I and m be integers. Then: 



n) 



B(h(l, m)) = B(h(l, m)s 2 ) = if I < 0, 
B(h(l,m)s\S2) = B(h{l,m)s2SiS2) = if I < — 1. 



B(h(l, m)) = B(h(l, m)s2S\S2) = for any I and < m < mo, 
B(h(l, m)s2) = for any I and < m < mo — 1. 



in) Assume that mo > 0. Then 

B{h(l,0)u iSl s 2 ) = 
with i = in the ramified case and i £ {1,2} in the split case. 

iv) In the ramified case, 



v) In the split case, 



B(h(l, 0)u sis 2 ) = forZ<-l. 
B(h(l, 0)ujSis 2 ) = for I < 0. 



Proof. These are standard arguments using the Pi-invariance of B and the definition of mo- ■ 
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5 The Hecke operators 

In the following lemmas we will give the value of Ti^B and Tq^B, where B £ S(A,6, Pi), on 
various double coset representatives from Proposition 4.2. The main tools are the integration 
formulas in Lemma 4.3 and the useful matrix identity (27). The proofs are long and tedious and 
we will not present them here. See [6] for details. 

5.1 Lemma. Let B S <S(A, 6, Pi), and let I and m be non-negative integers. Let h(l,m) be as 
in (25). Then the following formulas hold. 



i) 
ii) 



(T 1>0 B)(h(l,m)) =q 3 B(h(l + l, m)). 

(Ti j0 B)(h(l, m)s 2 ) = q 2 (q - l)B(h(l + 1, m)) 

—qB(h{l — 1, m + l)sis 2 ) if m < mo, 

qA(m)B(h(l + 1, m — 1)«2) + q(q — l)B(h{l — 1, m + l)siS2) if m > max(mo, 1), 



+ < 



q 2 B{h{l-l,l)siS 2 ) 



if m = m = 0, (-p J 



qh{m L )B{h{l, 0)u sis 2 ) + q{q - l)B{h{l - 1, l)s l82 ) if m = m = 0, (f ) = 0, 



Hi) 



q{A(w, l)B{h(l, 0)u 2 sis 2 ) + A(l, w)B(h(l, 0)uiflis 2 )) 
+q(q-2)B(h(l-l,l)siS 2 ) 



(T lfi B)(h(l, m)sis 2 ) = q 2 (q - l)B(h(l + 1, m)) 
' -qA{w)B{h(l + 1, m - l)s 2 ) 

q 2 B(h{l-l,m+l)sis 2 ) 



ifm = m = 0, (f) =1. 



+ < 



q(q + l)B{h{l - 1, l)sis 2 ) - qA{w)B{h(l + 1, -l)s 2 ) 

qA{w L )B(h{l, 0)u sis 2 ) + q 2 B(h(l - 1, l)sis 2 ) 
-qA{m)B(h(l + l,-l)s 2 ) 



if m < rriQ , 

if m > max(rao) 1)) 

ifm = m = 0, (f) = -1, 



if m = ttiq = 0, 



0, 



qA(l, w)B(h{l, 0)uisis 2 ) + qA(w, l)B(h(l, 0)u 2 sis 2 ) + q(q - l)B{h(l - 1, l) Sl s 2 ) 
-qA{w)B{h(l + 1, -l)s 2 ) if m = m = 0, (f ) = 1. 



(Ti fi B){h(l, m)s 2 sis 2 ) = q 2 {q - \)B{h{l + 1, m)) + A{w)B{h(l - 1, m)s 2 sis 2 ) 
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if m < tuq, 

q(q - l)B(h{l -l,m + l)si« 2 ) + (q ~ l)A(w)B(h{l + l,m - l)s 2 ) 

if m > max(rao, 1), 



( g 2 - l)J3(/»(i - 1, l)«is 2 ) 



ifm = m = 0, (f) =-1, 



+ < 



{q - l)A(m L )B(h(l,0)u s lS2 ) + q(q - l)B(h(l - 1, l)«i* 2 ) 

ifm = m = 0, (f) =0, 

(5 - 1) (A(l, w)B(h{l, 0)uisia 3 ) + A(w, l)£(7t(Z, 0)u 2 sis 2 )) 

+(g - l) 2 £(/i(/ - 1, l) Sl s 2 ) ifm = m = 0, (|) = 1. 

5.2 Lemma. Let A be an unramihed character of L x , and let I > — 1 be an integer. Then 
i) In the ramified case ( ^) =0, for aii integers I > — 1, 



(Ti, B)(/i(Z,0)tioai*2) 



-g 2 5(l) ifi = -l, 

g 2 (g- l)£(/i(Z + 1,0)) + q 2 B(h{l - 1, l)sis 2 ) if / > 0. 



ii) In the split case (^) = 1, for aii integers I > 0, 

(T lt0 B)(h(l, 0)u lSl s 2 ) = q 2 (q - l)B(h(l + 1, 0)) + q(q - l)B(h{l - 1, l)s x s 2 ) 

+ qA(l,m)B(h(l,0)uiSis 2 ), 

(T lfi B)(h(l, 0)u 2 s lS2 ) = q 2 (q - l)B(h(l + 1, 0)) + q(q - l)B(h(l - 1, l) Sl s 2 ) 

+ qA(w, l)B(h(l, 0)u 2 sis 2 ). 

5.3 Lemma. Let B £ <5(A, 8, P±), and let I and m be non-negative integers. Let h(l,m) be as 
in (25). Then the following formulas hold. 



i) 



(T Q ,iB)(h(l,m)) = { 



if m < mo, 

q 3 A(w)B(h(l + 2, m - I)) + q A B(h(l, m + 1)) 

if m > max(mo, 1), 

g 3 (g + 1)) ifm = m = 0, (f ) = -1, 

q 3 A(w L )B(h(l + 1, 0)) + q 4 B(h(l, 1)) ifm = m = 0, (|) = 0, 

q 3 (A(w, 1) + A(l, w))B{h{l + 1, 0)) + q 3 (q - l)B(h(l, 1)) 

ifm = m = 0, (£) = 1. 
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n) 



(T 0jl B)(h(l,m)s 2 ) 

' -q 3 B(h(l, m + l)sis 2 ) - A{w)B{h{l — 2, to + l)sis 2 ) if to < mo, 

q 3 A{w)B(h{l + 2, m - l)s 2 ) + A(w)' 2 B(h(l, m - l)s 2 ) 

+(q - l)A(w)B(h(l - 2, m + l)sis 2 ) + g 3 (g - l)B(h(l, to + l) Sl s 2 ) 

if m > max(mo, 1), 



9 4 S(/i(Z, l)sis 2 ) + qA{w)B{h(l - 2, l) ai s 2 ) 



if m = to = 0, (£) 



q 3 A{w L )B{h(l + 1, 0)u sis 2 ) + A{w)A{w L )B(h{l - 1, 0)u sis 2 ) 
+(g - l)A(o)B(li(l - 2, l)sis 2 ) + g 3 (g - l)B(h(l, l) Sl s 2 ) 

ifm = m = 0, (£) =0, 

g 3 (A(ro, l)5(/i(Z + 1, 0)n 2 sis 2 ) + A(l, o7)B(/i(i + 1, 0)uisifl 2 )) 

+A(m)(A(m,l)B(h(l - 1, 0)u 2 S!S 2 ) + A(l, w)B{h{l - l,0)u lSx s 2 )) 
+q 3 (q - 2)B(h(l, l)sis 2 ) + (g - 2)A(vj)B(h{l - 2, l)s lS2 ) 

if m = too = 0, (^) = 1. 



+ q 2 (q-l)B(h(l,m + l)) + < 



L 



-)qA(w)B(l), 
P 



if Z = to = 0, 
if I = 0, to > 1, 

q{q-l)A(w)B(h(l,m)) if I > 1. 



> . 



5.4 Lemma. Let A be an unramihed character of L x , and iet Z > —1 be an integer. Then 
i) In the ramified case (~) =0, for aii integers I > — 1, 

if Z = -1, 



(r 0)lJ B)(/i(Z,0) ? ioSiS2) 



g 4 i3(Zi(-l,l) SlS2 )- (7 2 A( roL )S(l) 
g 4 B(Zi(0,l)sis 2 ) 

+g 2 (g - l)A(tux)5(/i(l, 0)) - gA(tJ7)J3(l) if Z = 0, 
g 4 i3(/i(Z, l)ais 2 ) + qA(w)B{h{l - 2, l) Sl s 2 ) 
+q 2 (q-l)A(zu L )B(h(l + l,0)) 

+A(m)q(q - l)B(h(l, 0))) if Z > 1. 
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ii) In the split case (^) = 1, for all integers I > 0, 



(To A B)(h(l,0)u lSl s 2 ) 



(T 0il B)(h(l,Q)u2S lS2 ) 



f q 3 A{l,vu)B(h(l,0)u lSl s 2 ) + q 3 (q - l)B(h(0, l)*i* 2 ) 

+q 2 (q~ l)A(tJ7,l)J3(/»(l,0)) if Z = 0, 

g 3 A(l, n7)B(fc(J + 1, 0)fiiaia 2 ) + Q 3 (q ~ l)B(h(l, l)si* 2 ) 
+g 2 (9-l)A(w, l)5(/i(Z + l,0)) 
+A(tu)g(g-l)S(/i(Z,0)) 
+A(ro)A(l,ro)S(/i(/ - l,0)«isia 2 ) 

+(g - l)A{w)B{h(l - 2, l)s lS2 ) if I > 1. 

f g 3 A(ro, l)B(/i(l, 0)« 2 sis 2 ) + g 3 (g - l)B(h(0, l) Sl s 2 ) 

+q 2 (q-l)A(l,w)B(h(l,0)) if 1 = 0, 

q 3 A(m, l)B(h(l + 1, 0)u 2Sl s 2 ) + q 3 (q - l)B(h(l, l)s lS2 ) 
+q*(q-l)A(l,w)B(h(l + l,0)) 
+A{w)q(q-l)B(h(l,0)) 
+A{w)A(vo, l)B(h(l - 1, 0)u 2 sis 2 ) 

+(q - l)A{w)B{h{l - 2, l)sis 2 ) if / > 1. 

5.5 Lemma. Let B £ S(A,6,Pi) be such that T\$B = XB and Tq iB = \xB. Let I and m be 
non-negative integers. 

• For m > max(mo, 1), or for m > tuq — 1 if niQ > 0, we have 

\A(ru)B(h{l, m)s 2 ) - u.qB(h(l + 1, m)s 2 ) + Xq 3 B(h{l + 2, m)s 2 ) 
= q 5 (q - l)B(h(l + 3, m)) - q 3 (q - l)B(h{l + l,m+ 1)) 

• For m > max(mo, 1), we have 

fxB(h(0, m)s 2 ) - q 2 XB(h(l,m)s 2 ) - A{m) 2 B{h{0, m - l)s 2 ) 
= q 2 (q - l)B(h(0, m + 1)) - q A {q - l)B(h(2, m)) 

• For niQ > 0, we have 

fiB(h(0, m )s 2 ) - q 2 XB(h(l, m )s 2 ) - A(w) 2 B(h(0, m - l)s 2 ) 
= q~ 2 (q-l)( t M-X 2 )B(h(0,m Q )) 

• For I > 0, niQ > 0, we have 

XA(uj)B(h(l, m - l)s 2 ) - fiqB(h(l + 1, m - l)s 2 ) + Xq 3 B(h(l + 2, m - l)s 2 ) 

= -A(g-l)B(/i(i,mo)) (35) 



(32) 



(33) 



(34) 



Proof. (32) and (33) follow from Lemma 5.3 ii) and Lemma 5.1 ii). (34) follows from (33), Lemma 
5.1 i) and Lemma 5.3 i). (35) follows from (32), the identity XB(h(l,mo)) = q 3 B(h(l + 1, mo)) 
and some automatic vanishing. ■ 
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6 The main tower 

Again we consider the matrix S and the associated character 6 of U(F); see (10). As usual, the 
assumptions (4) are in force. Let A be a character of T{F) and define the non-negative integer 
mo as in (31). Let B be a function in the space <S(A, 9, Pi)- We refer to the values of B at the 
elements h(l,m), defined in (25), as the main tower (in view of Proposition 4.2, there is also an 
S2-tower etc). Note that B(h(l,m)) = for / < or < m < tuq by Lemma 4.4. The following 
result relates the values of B(h(l,m)) to B(h(0,mo)), only assuming that B is an eigenfunction 
for Tifi and Tq\. In particular, it shows that the entire main tower is zero if B(h(0,mo)) = 0. 

6.1 Proposition. Let B £ S(A,6, Pi) be an eigenfunction for Ti o and Tq\ with eigenvalues X 
and fjb, respectively. Then 

B(h(l + 1, to)) = \q- 3 B(h(l, to)) for all I > and m > 0. (36) 

Furthermore, for any I > 0, there is a formal identity 

1 - Kq~ A Y 



m=mo 



where 



if to > 0, 

(tf + LTV if too = and (|) = -1, 

A(ro L )A if to = and (|) = 0, 

k (g- l) _1 (gA(A(ro, 1) +A(l,ro)) - /x) if to = and (|) = 1. 

Proof. The relation (36) is immediate from Lemma 5.1 i). Combining (36) with Lemma 5.3 i), 
we get, for I > and to > too, 

q^B(h(l, to + 2)) - fiB(/i(J, to + 1)) + \ 2 q~ 3 A(zu)B(h(l, to)) = 0. (37) 

We multiply this by Y m+2 and apply X^m=m ^° both sides, arriving at the formal identity 

f. awi , m))y - = (. 1 -#)8W^))^2«W I »* ± i)) y .„„ 

m=mo 

Setting to = too in Lemma 5.3 i) and using (36) provides a relation between B(h(l,mo)) and 
B(h(l,rriQ + 1)). Substituting this relation, we obtain the asserted formula. ■ 



7 Generic representations and split Bessel models 

We recall some basic facts about generic representations of GSp 4 (i ? ), and refer to Sect. 2.6 of 
[8] for details. We denote by the unipotent radical of the Borel subgroup B, and for c l5 C2 
in F x , consider the character ip ci) c2 °f N(F) given in Sect. 2.1 of [8]. An irreducible, admissible 
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representation tt of GSp 4 (P) is called generic if HomjvYF)(7r, ■0ci,c 2 ) 7^ 0- 111 this case there is an 
associated Whittaker model W(tt, ip Cl ,c 2 ) consisting of functions GSp 4 (P) — > C that transform 
on the left according to Y> C i,c2- For W G W(7r, -0 CljC2 ), there is an associated zeta integral 



Z(s,W)= j Jw( 



F x F 



a 

a 

x 1 



1 



I s - 3 / 2 dxd y 



(38) 



This integral is convergent for Re(s) > sq, where sq is independent of W; see [8], Proposition 
2.6.3. Moreover, there exists an L-factor of the form L(s,tt) = Q(q~ s )~ 1 , Q(X) G C[X], Q(0) = 
1, such that 

Z T ^ W } eC[q- s ,q s ] for all Ty 6W(i,^, C2 ). (39) 

We consider split Bessel models with respect to the quadratic form S defined in (12). Let 8 
be the corresponding character of U(F). The resulting group T(F), defined in (2), is a split 
torus. We think of T{F) embedded into GSp 4 (i ? ) as all matrices of the form diag(a, b, b, a) with 
a, b G F x . We write a character A of T(F) as a function A(a, b). Consider the functional f s on 
the ?/> CliC2 -Whittaker model of tt given by 



fs(W) 



Z(S,7T(S 2 )(W)) 
L(s,7t) 



(40) 



By analytic continuation and the defining property of L(s,n), this is a well-defined and non- 
zero functional on tt for any value of s. A direct computation shows that the functional f s 
is a split (A, #)-Bessel functional with respect to the character A given by A(diag(a, b, b, a)) = 
\a~ 1 b\~ s+1 / 2 . If we assume that tt has trivial central character, then any unramified character of 
T(F) is of this form for an appropriate s. 



Zeta integrals of Siegel vectors 

Let (tt, V) be an irreducible, admissible, generic representation of GSp 4 (i ? ) with unramified 
central character. We assume that V = W(tt, ip Cl ,c 2 ) is the Whittaker model with respect to the 
character ^ Cl , C2 of N(F). For what follows we will assume that ci,C2 G o x . Recall the Siegel 
congruence subgroup Pi and the Klingen congruence subgroup P2 defined in (6). 

7.1 Lemma. Let (tt, V) be as above, and let W be an element ofV = W(tt, V ; ci,c 2 )- 
i) IfW is Pi -invariant, then 

s 2 )\a\ s - 3 / 2 d x a. 



Z(s,tt(s 2 )W) 



W( 
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ii) IfW is P2-invariant, then 

)\a\ s - 3 / 2 d x a. 



Proof, ii) is a special case of Lemma 4.1.1 of [8], and i) is proved similarly. ■ 
Let W S V be a ^-invariant vector. Then 

T Si W := J2 < 

9 6GL 2 (o)/rO(p) 

is Pi -invariant. Using Lemma 7.1, the standard representatives for GL2(o)/r°(p) and (27), one 
calculates that 

s 2 s l )\a\ s - 3/2 d x a + Z(s,W). (41) 



The Ila case 

7.2 Lemma. Let it = X^GL(2) xi c be a representation of type Ila with unramified x an d o~. Let 
a = x( w ) an d 7 = cr(zu). We assume that a 2 j 2 = 1, i.e., that ir has trivial central character. 
Let Wo he a non-zero i^ para (p) -invariant vector in the ip Cl ^ C2 -Whittaker model of tt normalzed 
such that Z(s, Wo) = L(s, tt). Let uj = —cry be the eigenvalue of the Atkin-Lehner element n on 
W Q . 

i) For any s G C, 

Z(s,7r(s 2 )(T Si Wo)) = {uq s ~ 112 + l)L( S ,vr). 

ii) Ifujq 8 - 1 / 2 + 1 = 0, then 

Z(s,T Si W ) = (1-q- 1 )- 1 . 

Proof. We may assume that s is in the region of convergence. Since the element t\ = 
h(l, 0) _1 siS2Si^(l) 0) lies in the paramodular group ET para (p) we have, for any g in GSp 4 (F), 
the relation ujWo(gs2Si) = Wo(gh(l,Q)). Substituting this into (41), we obtain 

)|a| s " 3 / 2 d x a + Z(s,W ) 

= (ojq s ^ 2 + l)L(s,7T). 



Z(s,W) 



W( 



)w 



Z(s,ir( S2 )(T Si W))=q J W( 



FX 



aw 



Z(s,7T(s 2 )(T S iWo))=uq / W ( 



aw 
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This proves part i) of the lemma. Proof of part ii) is a long computation and we do not present 
it here. See [6] for details. ■ 

For the following proposition we continue to assume that tt = X^gl(2) x o" is a representation 
of type Ha with unramified x an d cr, but we will drop the condition that tt has trivial central 
character. If the non-zero vector W spans the space of Pi-invariant vectors, then we still have 
rjW = ojW with oj = —cry, but this constant is no longer necessarily ±1. We consider split Bessel 
models with respect S as in (12). We want the character A of T(F) to coincide on the center of 
GSp 4 (F) with the central character of tt, i.e., A(a, a) = (xc) 2 (a). Since A(w, 1)A(1, w) = oj 2 , 
we have A(l,w) = —oj if and only if A{w, 1) = —oj. 

7.3 Proposition. Assume that tt = xStGL(2) x 0" is a representation of type Ha with unramified 
X and <7. Let S, 6 and T{F) be as above. Let A be an unramified character of T(F) such that 
A(a, a) = (xo~) 2 (a). Let B be a non-zero vector in the (A,9)-Bessel model of tt spanning the 
one-dimensional space of Pi-invariant vectors. Then we have 

A(w,l)^-u^A(l,w) 5(1)^0. 

Proof. After twisting by an unramified character, we may assume that tt has trivial central 
character. Let Wq be a non-zero vector in the ip ci C2 -Whittaker model of tt spanning the one- 
dimensional space of i^ para (p)-invariant vectors. By Lemma 7.2, the vector TgiWo is non-zero, 
and hence spans the one-dimensional space of Pi-invariant vectors. Let f s be as in (40). Note 
that A(w, 1) = — oj = A(l, w) if and only if ojq s ~ 1 / 2 + 1 = 0. Then, by i) of Lemma 7.2, we have 
f s (TsiWo) ^ if and only if A{w, 1) 7^ — oj 7^ A(l,w). The proposition now follows from the 
fact that /s(TsiWo) 7^ is equivalent to B{1) 7^ by uniqueness of Bessel models. ■ 



The Via case 

Let tt = t(S,v~ 1 I 2 o-) be the representation of type Via. We assume that a is unramified and 
that tt has trivial central character, i.e., a 2 = 1. This is a representation of conductor 2 By 
Table A.8 of [8], 

L(s, tt) = L(s, v 1 ' 2 ?) 2 = \_ 1/2 _ s , r (42) 

(1 — a[w)q L ' z s y 

We assume that tt is given in its ^ cliC2 -Whittaker model. Let Wq be the paramodular newform, 
i.e., a non-zero element invariant under the paramodular group of level p 2 ; see (7). By Theorem 
7.5.4 of [8], we can normalize Wq such that Z(s,Wq) = L(s,tt). We let 



W':= < 

x,y,z£o/p 



1 yw 

1 

xw 1 
xw zw —yw 1 



)W . 



(43) 



This is a ^-invariant vector; it was called the shadow of the newform in Sect. 7.4 of [8]. By 
Proposition 7.4.8 of [8], 

Z(s,W') = (l-q- 1 )L(s,TT). (44) 
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7.4 Lemma. For any complex number s, 

= /2+ , 

Proof. We may assume that s is in the region of convergence. By (41) and (44), 



(45) 



Z(s,ir( S2 )(T Si W'))=q J W( 



1 



s 2 si)\ar 3 / 2 d x a + (l- q- x )L{a, tt). (46) 



To evaluate the integral in this equation, we compute the zeta integral Z(s, tt(s2Si) W) in two 
different ways - first, by using the local functional equation for Z(s, W), and second, by using a 
direct computation and the fact that the representation has no fT para (p)-invariant vectors. The 
result is that 



W'( 



S2S1 



)|a| s " 3/2 d x a = (q - l)^" 1 ^, tt) - 1). 



(47) 



Prom (46) and (47), we now get 

Z(s, ir(s 2 )(T Si W')) = (q- l)q 2s (L(s, vr) - 1) + (1 - g" 1 )^, vr). (48) 
Using the explicit form (42) of L(s,tt), the assertion follows. See [6] for further details. ■ 



7.5 Proposition. Assume that tt = t(S, z^~ 1 / 2 cj) is a representation of type Via with unramihed 
(T. Let S be as in (12). Let A be an unramihed character ofT(F) such that A(a, 0) = a 2 (a). 
Let B be a non-zero vector in the (A, 6)-Bessel model of tt spanning the one-dimensional space 
of Pi -invariant vectors. Then B(l) 7^ 0. 

Proof. After twisting by an unramified character, we may assume that tt has trivial central 
character. Let Wq be a non-zero vector in the V ; ci,c 2 "Whittaker model of tt spanning the one- 
dimensional space of X para (p 2 )-invariant vectors, and let W' be the ^-invariant vector defined 
in (43). By Lemma 7.4, the vector T§\W is non-zero, and hence spans the one-dimensional 
space of Pi-invariant vectors. Let f s be as in (40). By Lemma 7.4, we have f s (TsiW) 7^ 0. By 
uniqueness of Bessel models, this is equivalent to B(l) / 0. ■ 



8 The one-dimensional cases 

In this section we will identify good test vectors for those irreducible, admissible representations 
of GSp 4 (i ? ) which are not spherical, but possess a one-dimensional space of Pi-invariant vectors. 
A look at Table 1 shows that these are the Iwahori-spherical representations of type Ha, IVc, 
Vb, Via and VIb (Vc is a twist of Vb and is not counted separately). This entire section assumes 
that the elements a, b, c satisfy the conditions (4). The matrix S, the group T(F) = L x and 
the character 9 have the usual meaning. 
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8.1 Lemma. Let A be a character of L x , and mo as in (31). 
i) Assume that B E 5(A, 9, Pi) satisfies 

T h0 B = XB, T 0j iB = fiB, r]B = uB 
with complex numbers X,/j,,uj satisfying A = — quo. 

• Ifm = 0, (|) = and A(w L ) = -co, then B = 0. 

• If to = 0, (J) = 1, A(l,tJ7) = -u = A(w,l) and B(l) = 0, then 



B = 



B(iLlSlS2) = 



B(u 2 sis 2 ) = 0. 



• Otherwise, 



B = ^> B(h(0, too)) = 0. 
ii) Assume that B £ S(A, 8, P\) satisfies r\B = ujB and 

I 



Then 



c6o/p 



B = 



1 



1 



)B + ir(s 2 )B = 0. 



B(h(0,m )) = 0. 



(49) 



Proof, i) From Lemma 5.1 and the Atkin-Lehner relations, we get 
XB(h(l,m)) = q 3 B(h(l + l,m)), for l,m > 0, 



(50) 



(q - l)B(h(l, to)) = q 2 B(h(l, m)s 2 ) + quB(h(l + 1, to - l)s 2 ) for / > 0, to > max(m , 1). 

(51) 

Assume that too > and that B(h(0,mo)) = 0. Then, by Proposition 6.1, the values 
B(h(l,m)) are zero for all I and m. Considering (51) with I = 0, (51) with / = 1, Lemma 5.5 
with I = 0, m = too — 1, (33) and Lemma 5.3 ii) with I = 0, to = too — 1 we get a homogeneous 
system of 5 linear equations with a non-singular matrix in the variables 

B(h(0,m o - l)s 2 ), B(h(l,m - l)s 2 ), B(h(2,m - l)s 2 ), B(h(0,m )s 2 ), B(h(l,m )s 2 ). 

Hence, the above values are equal to zero. Lemma 5.5 then implies that B(h(l,mo — l)s 2 ) = 
for all / > 0. Using (51), it follows that B(h(l,m)s 2 ) = for all Z > and to > iuq — 1. The 
Atkin-Lehner relations now imply that the main tower, S2-tower, siS2-tower and S2SiS2-tower 
are all zero. By Proposition 4.2 and Lemma 4.4, the function B is zero. This proves i) of the 
lemma for too > 0. 

Now assume that too = 0. Using Proposition 6.1, Lemma 4.4, (51), and the Atkin-Lehner 
relations, we can show the following: If B(l) = and B(h(l,0)s 2 ) = for all I > 0, then 
B(h(l, m)w) = for all I £ Z, all to > 0, and all w G {1, s 2 , s 2 s\s 2 }, as well as B(h(l, m)s\s 2 ) = 
for all I € Z and all to > 1. 
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Assume that (^) = —1 (the inert case). Then, from Lemma 5.1 ii), (50), Atkin-Lehner 
relations and using A = — qui, we get q(q + l)B(h(l,0)s2) = (q — l)B(h(l,0)) for I > 0. Now, 
from the double coset representatives in Proposition 4.2, it follows that B = if B(l) = 0. The 
other cases are similar. See [6] for details. 

ii) Evaluating (49) at h(l,m)s2, we obtain 

qB(h(l, m)s 2 ) = -B(h(l, m)) (52) 

for all l,m > 0. Let i = in the ramified case and i = 1 or i = 2 in the split case. Evaluating 
(49) at h(l, 0)uiS±S2SiS2 leads to 

qB(h(l, 0)s 2 s lS2 ) = -B(h{l, 0)n iSl s 2 ) (53) 

for / > —1; observe here the defining property (5) of the elements Uj. Assume that P(/i(0, mo)), 
and therefore, by Proposition 6.1, the whole main tower, is zero. Then, by (52) and Lemma 
4.4, the entire S2-tower is also zero. By the Atkin-Lehner relations, the s\S2 and S2S1S2 towers 
are also zero. In the inert case, in view of the double cosets given in Proposition 4.2, and v) of 
Lemma 4.4, it follows that B = 0. Taking into account (53), the same conclusion holds in the 
ramified and split cases. ■ 

The condition A = — qui in i) of the above lemma is satisfied by the representations of type Ha, 
IVc, Vb and Via. The representations of type VIb satisfies A = qui. These representations have 
a one-dimensional space of Pi-invariant vectors, but no non-zero P2-invariant vectors. Hence, if 
a non-zero Pi-invariant vector B is made P2-invariant by summation, the result is zero - using 
standard representatives, we get (49) in ii) of the above lemma. 



The main result 

The following theorem, which is the main result of this section, identifies good test vectors 
for those irreducible, admissible, infinite-dimensional representations of GSp 4 (F) that have a 
one-dimensional space of Pi -invariant vectors. 

8.2 Theorem. Let tt be an irreducible, admissible, Iwahori-spherical representation of GSp 4 (P) 
that is not spherical but has a one-dimensional space of Pi -invariant vectors. Let S be the matrix 
defined in (1), with a, b,c subject to the conditions (4). Let T(F) be the group defined in (2). 
Let 9 be the character ofU(F) defined in (10), and let A be a character ofT(F) = L x . Let 
mo be as in (31). We assume that tt admits a (A,9)-Bessel model. Let B be an element in this 
Bessel model spanning the space of P\-invariant vectors. 

i) Assume that tt is of type Ila. Then B(h(0, mo)) 7^ 0, except in the split case with A(l, w) = 
—u = A(n7, 1). In this latter case B(l) = 0, but B{uiS\S2) 7^ for i = 1,2. Here, the 
elements Ui are defined in (30). 

ii) If it is of type IVc, Vb, Via or VIb, then B(h(0,m o )) ^ 0. 

Proof. Let B be a non-zero Pi-invariant vector in the (A, #)-Bessel model of tt. Then B is an 
element of the space 5(A, 9,Pi). Since the space of Pi-invariant vectors in tt is one-dimensional, 
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B is an eigenvector for T^o, Tq^ and m let A, \x and co be the respective eigenvalues. Lemma 
8.1 proves our assertions in case tuq > 0. For the rest of the proof we will therefore assume that 
mo = 0, meaning that A is unramified. 

i) In this case we have A = — qui. If we are not in the split case, or if we are in the split 
case and A(l,w) ^ —uj then our assertion follows from Lemma 8.1 i). Assume that we are in 
the split case and that A(l,w) = —uj = A(w, 1). Then B(l) = by Proposition 7.3 and (14). 
Hence our assertion follows from Lemma 8.1 i). 

ii) If 7r is of type VIb, then B satisfies (49) and the assertion follows from Lemma 8.1 ii). 
Assume that ir is of type IVc, Vb or Via. If we are not in the split case, our assertions follow 
from Lemma 8.1 i). Assume we are in the split case, and that tt is of type IVc or Vb. Then, 
by Table 2 and Table 3, we have A(1,vj) ^ —uj. Hence our assertions follow from Lemma 8.1 
i). Assume we are in the split case, and that tt is of type Via. Then our assertion follows from 
Proposition 7.5 and (14). ■ 



9 The two-dimensional cases 

In this section, let ir be an irreducible, admissible representation of GSp 4 (i ? ) of type Ilia or IVb. 
In both cases the space of Pi-invariant vectors is two-dimensional. 

The Ilia case 

Let B\ and B 2 be common eigenvectors for T\ t o and Tq^ in the Ilia case. Then, one can choose 
the normalizations such that 

Ti >0 B 1 = arfqBi, T lfi B 2 = jqB 2 , 

T^iB 1 =a 1 2 {aq + l)qB 1 , T ,i B 2 = ai 2 {a~ l q + l)q B 2 , (54) 
rjBi = ajB 2 , rjB 2 = jBi. 

Note that a 7^ 1 in the Ilia case; see Table 4. 

9.1 Lemma. Let A be a character of L x , and m$ as in (31 ). Assume that B\,B 2 £ <S(A, 9, P\) 
satisfy (54) with a / 1. Assume also that A(w) = a~/ 2 . Then 

Bi = Bi(h(0,m o )) = 0. 

Proof. Using the Atkin-Lehner relations (54) and Lemma 5.1, we get for any I > —1 and m > 0, 

r )Bi(h(l,m)s 2 s\s 2 ) = q 2 B\{h(l + l,m)s 2 sis 2 ), (55) 

and, for I > and m > max(mo, 1), the three equations 

= -a-yqB 1 (h(l,m)s 1 s 2 ) + q 2 B 1 (h(l - 1, m + l)sis 2 ) + 07(9 - l)Bi(h(l,m)), (56) 
= -jqB^hQ, + l,m - l)s 2 ) + q 2 B 1 (h{l,m)s 2 ) + q 2 (q - l)B 1 (h(l,m)s 2 s 1 s 2 ) : (57) 
= q 3 B 1 (h(l, m)s 2 s 1 s 2 ) + q 2 B 1 (h(l, m)s 2 ) + qBi(h(l, m)s x s 2 ) + Bt(h(l, m)). (58) 
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We will first consider the case mo > 0. Assume that Bi(h(0,mo)) = 0; we will show that 
B\ = B2 = 0. Note that, by the Atkin-Lehner relations, we only need to show that B\ = 0. By 
Proposition 6.1, we know that Bi(h(l,m)) = for all l,m > 0. Considering (58) with I = and 
m = mo, Lemma 5.3 ii) with B = B2, I = and m = rriQ — 1, (35) applied to B\, (34) applied 
to B\, Lemma 5.3 ii) with B = B2, I = and m = mo, Lemma 5.3 ii) with B = B%, I = and 
m = rriQ — 1, (35) applied to B2 and Lemma 5.3 ii) with B = B\, I = and m = mo, we get a 
homogeneous system of 8 linear equations in the 7 variables 

Bi(h(0,m - l)s 2 ), Bi(h(0,m,o)s 2 ), Bi(h(l,m )s 2 ), Bi(h(0,mo)sis 2 ), 
B 1 (h(l,mo)s 1 s 2 ), B 1 (h(-l,m )s 1 s 2 ), B 1 (h(0,mo)s2S 1 s 2 ). (59) 

For any a, either the set of first 7 equations or the set of last 7 equations has a non-singular 
matrix. Hence, all the values in (59) are zero. Now (32) and (57) imply that B\{h(l,m)s2) = 
for all I > 0, m = tuq — 1 or m = uiq. Using (55) and (58), we get Bi(h(l,mo)s2SiS2) = 
Bi(h(l,mo)siS2) = for / > —1. Now, using (56), (57), (58), induction, Proposition 4.2 and the 
automatic vanishing from Lemma 4.4, it follows that B\ = 0. This concludes our proof in case 
mo > 0. 

We next consider the case mo = 0. Assume that B\{1) = 0; we will show that B\ = 0. By 
Proposition 6.1, we know that B\{h{l,m)) = for all l,m > 0. Suppose we can show that B\ 
vanishes on all the double coset representatives in Proposition 4.2 that have m = and that 
Bi(h(l, l)siS2) = for all I > —1. Using induction and (56), we get Bi(h(l,m)siS2) = for all 
I > — 1 and m > 0. Now, induction and (57), (58), gives us B\ = 0, and hence, B2 = 0. 

We will give the proof of the inert case (-p 1 ) = —1 here. The other cases are similar (see [6]). 
Using Lemma 5.1 ii), we get, for I > 0, 

orfqB x (h(l, 0)s 2 ) = q 2 B 1 (h(l - 1, l) Sl s 2 ). (60) 

Using (55) and Lemma 5.1 iv), we get, for I > 0, 

a 1 qB l {h{l, 0)s 2 s lS 2) = -(q+ l)B x {h{l - 1, l)s x s 2 ). (61) 

Hence, from (55), (60) and (61), we get, for I > 0, 

-yBi(h(l, 0)s 2 ) = q 2 B 1 {h(l + 1, 0)s 2 ). (62) 

Using (60), (62) and Lemma 5.3 ii), we get 

aj 2 (aq + l)gBi(a 3 ) = 9 4 #i(M0, l)*i*2) = a^B^l, 0)s 2 ) = a 7 2 g J B 1 (s 2 ). (63) 

Since a 7^ , we get Bi(s 2 ) = 0. Now (60), (61) and (62) implies that B\ vanishes on all the 
double coset representatives in Proposition 4.2 that have m = 0. Hence B\ = 0, as claimed. ■ 

The IVb case 

Let B\ and B2 be common eigenvectors for X^o and T$^ in the IVb case. We can choose the 
normalizations such that 

X li0 £i=7-Bi, Ti fi B 2 = -/q 2 B 2 , 
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T , 1 B 1 = 1 2 (q+l)B 1 , T 0A B 2 = 1 2 q(q 3 + 1)B 2 , (64) 
i]Bi=jB 2 , r\B-i = ^B\. 

Recall that 7 = o~(w), where a is an unramified character. From Table 2, a (A, #)-Bessel model 
exists if and only if A = aoN^jp. In particular, the number mo defined in (31) must be zero, i.e., 
A must be unramified. The central character condition is equivalent to A(w) = 7 2 . Moreover, in 
the ramified case (-) =0, evaluating at wl, we get A(wl) = 7, and in the split case (^) = 1, 
evaluating at (w, 1) and (l,w), we get A(w, 1) = A(l,w) = 7. 

9.2 Lemma. Let A be an unramified character of L x satisfying A(tzj) = 7 2 . If (^) = 0, 
assume that A(vjl) = 7, and if (-^) = 1, assume that A(w, 1) = A(l,m) = 7. Assume that 
B U B 2 € S(A,0,Pi) satisfy (64). Then 

Si = 5i(l) = <^ S 2 (1) = S 2 = 0. 

Proof. The proof is similar to that of Lemma 9.1, mo = case, and is therefore omitted. See 
[6] for details. ■ 



The main result 

The following theorem identifies good test vectors for those irreducible, admissible representa- 
tions of GSp 4 (T) that are not spherical but have a two-dimensional space of Pi-invariant vectors. 
Recall from Table 1 that these are precisely the Iwahori-spherical representations of type Ilia 
and IVb. 

9.3 Theorem. Let n be an irreducible, admissible, Iwahori-spherical representation of GSp 4 (i ? ) 
that is not spherical but has a two-dimensional space of P\-invariant vectors. Let S be the matrix 
dehned in (1), with a, b,c subject to the conditions (4). Let T(F) be the group dehned in (2). 
Let be the character ofU(F) dehned in (10), and let A be a character ofT(F) = L x . Let mo 
be as in (31). We assume that tt admits a (A,8)-Bessel model. Then the space of Pi -invariant 
vectors is spanned by common eigenvectors for the Hecke operators Ti ; o and To^, and if B is 
any such eigenvector, then B(/i(0,mo)) 7^ 0. 

Proof. Assume first that tt is of type Ilia. Then tt has a Bessel model with respect to any A; 
see Table 2. Let B\ and B 2 be the Pi-invariant vectors which are common eigenvectors for T^o 
and lb,!, as in (54). Then i?i(/i(0, mo)) ^ by Lemma 9.1. If we replace 7 by a _1 7 and then a 
by a -1 in the equations (54), then the roles of B\ and B 2 get reversed. This symmetry shows 
that also B 2 (h(0,m )) / 0. 

Now assume that it is the representation L(u 2 , ^ _1 crStGs P (2)) °f tyP e IVb. Then, by Table 
2, we must have A = a o N L / F . In particular, A is unramified and satisfies the hypotheses of 
Lemma 9.2. Let B\ and B 2 be the Pi-invariant vectors which are common eigenvectors for T^o 
and To,!, as in (64). Then £i(l) / and B 2 (l) / by Lemma 9.2. ■ 
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